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ABSTRACT 

A study was conducted to characterize the 
problem-solving processes of individuals with high scholastic 
aptitudes and individuals with low scholastic aptitudes. From a group 
of 532 Chicago area high school juniors, a group who scored high Qn 
the Differential Aptitude Test and a group that scored low were 
selected. They were given nine problems to solve; they chose 
questions from a list until they felt they had enough information to 
solve each problem. A number of scoring methods were applied to the 
problems to determine the differences that existed between the two 
groups in relation to this type of test. The score for the number of 
problems right for each subject was higgler for the upper group than 
the corresponding score for the lower group. Fewer worthless 
questions were asked by the upper group, and the mean number of 
questions asked for each problem was less for the upper group. 
Differences between the groups were observed by plotting a ppint on a 
graph that was respresentative of the quality of the process an 
individual had used to solve the problem. . (For related document, see 
TM 003 09a.) (Author/KM) 
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Chapter I 



INTRODUCTION 

The problem of the relationship between problem solving ability and 
intelligence, though not extensively mentioned in the literature, is an 
important and vital topic for psychology. The present thesis represents 
an initial attempt to understand more about this relationship. The present 
study is similar in some parts to others that have appeared in the litera** 
ture in the past. The major exception to this similarity is the use of a 
new technique for studying the processes involved in problem solving that 
have been develq^d by H. J. A. Bimoldi and associates at the Loyola Pay* 
chometrlc Laboratory, Loyola University, Chicago, Illinois. 

As one reads this thesis he will probably be disappointed to find that 
it asks more questions than it answers. This is not necessarily a sign of 
failure for It does point the way to a number of fruitful ideas for possible 
future research. This ability to provc^e questions seems to be a constant 
companion of the method used to study the processes since not only has it 
led to significant findings but it has also opened new avenues of approach 
with each n^ application. The bibliography at the end of this thesis is ac* 
tually a very exciting history of a scientific tool and it's evolution from 
a germ of an idea to a valuable tool for research on mental testing. Even 
the method of scoring the problems in terms of process that has developed 
along %ilth this technique, has been Improved from publication to publica- 
tion. In the first few studies, where the diagnostic processes used in med- 
icine were the subject of the research ^ a method based on group performance 
and the popularity of the individual questions was used. Later on, when 
methods were developed which allowed the experimenter to control the con- 
tent and the structure of the problems, scoring was based on an apriori 
analysis of the logical relationships that the experimenter had built into 
the problem, ibis latter method had the advantage of being based on the 
logical structure of the problems rather then on the responses of the group 
taking the test. It 6lso allowed tho experimenter to be aware of the in* 
hcri^nt difficulty of the probletas and the most logical approach that could- 
be used in solving them even before the research watf begun* 

Other methods of scoring and other types of problems than those that 
will be seen in this thesis have been developed and applied in different 
ways. It should not be assuiaed that because they do not appear here that 
they are in any way inferior or not applicable to this problem. They do not 
appear because there has been a conscious effort on the part of the pre- 
sent author to limit this paper in order that it be kept to a reasonable 
length. 

The Important attribute of this method of analy2ing problem solving 
which we have mentioned is that while it does give the person testing, 
the Information available from other more coamon forms of tests, e.g., 
right and wrong answer mr soluti<m, it also gives additional informaticm. 
This additional information concerns the process or the tactic used by the 
subject In reachit^ his end-product or solution. In general those processes 
that are in agreement with the logical structure of the problem lead to 
correct solutions while those processes which depart from the logical struc- 
ture lead to incorrect solutions. This however is not the full story. 



These tactics indicate the ability of the subject to plan his attack, 
and his ability to change i/hen cme line of attack appears inapprq^iriate* 
It allows us to have sooie insight into the versatility of the subjects^ 

It should not be inferred from the language used in this study that 
the processes per se, of the subjects, are the direct object of the study • 
What is being studied is a manifestation oi the thought processes involved 
in solving the problem as represented in the overt process of selecting 
questi<ms vhich give information germaine to the problem. While this is not 
a study o£ the thought process itself it is much closer than methods which 
infer the characteristics of the respcmse using merely the solution of the 
problem^ It is also a gain in objectivity over methods such as introspec- 
tion and **thinking aloud**, since the interpretation of these latter methods 
is necessarily subjective and qualitative tdiile the interpretation of the 
present method is to a great extent objective and it's scoring techniques 
are quantitative* 
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Chapter II 

REVIEW OP RELATED LITERATURE 

The classical monograph by Duncker (7) represents one of the first 
important attempts to study the processes involved in solving problems. 
He had his subjects think out loud while they were solving problem^, ^nd 
thus he could check the quality of their tactics. Bloom and Broder (1) 
using this thinking out loud technique, correlated the quality of their 
subjects' tactics in solving problems with tests of aptitude and achieve- 
ment. It can be seen that the study by Bloom and Broder will be similar 
in some respects to the study presented in this thesis. The primary point 
of difference is that the technique tot studyj.ng the tactics the subjects 
used is the oae that has been briefly discussed in the Introducticm. 

The technique used by Bryan (3) and by Glaser, Damrin and Gardner (8) 
is very similar to the present one but it^a application was primarily 
to the analysis of troubleshooting ability in electronics. It should also 
be said that this technique was developed as much as a training ald» as It 
was for a test. The authors suggest that any type of diagnostic situa- 
tion could be covered by the technique wt4?.ch they call the "tab-item" 
technique. The method developed by Rimoldi and associates at Loyola Uni- 
versity, Chicago, Illinois, has found application in many different areas 
outside of diagnostics where it was originally developed. Some of these 
applications will be mentioned below. Anoth<*r major difference between 
the "tab-item** technique and the method developed by Rimoldi and associates 
is that in the former the answer is made by way of choosing the correct 
answer from a number of possible answers. In other words, after the subject 
had received the answer to a few of the items, he could guess which com- 
ponent was faulty, and lift the tab over this component and receive his 
answer. In the Rimoldi technique the answer must be constructed by the 
subject from the information obtained in the form of answers to the ques- 
tions that the subject asks. In other words there is little chance for 
the subject to guess. 

The present technique was first developed as a measurement and re- 
search device in connection with the skills involved in the medical clini- 
cal diagnostic process. The development and applications of the techni- 
que In this form are reported in a number of articles (5,6,10,14,15,19,22, 
24,25,26). It has also been used to study personality appraisal in terms 
of process by Gunn (9). Rimoldi presented papexs in which he made the in- 
itial applications to the study of processes involved in complex reasoning 
and problem solving (11,12,13,18,20,23). Rimoldi and Majewska (21) pre- 
sented a research proposal for the study of decision processes involved 
in mathematical thinking. Rimoldi and Devane (16) and Rimoldi, Fogliatto, 
Haley, Reyes, Erdmann, and Zacharia have presented research related to the 
training of problem solving ability, using this technique. Tabor has pre- 
sented research on the processes involved In the interpretation of the 
Rorschach using this technique (29)« 
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Chapter III 

PROCEDURE 

A. Purpose 

The Itnnediate purpose of this thesis is to characterize the problem 
solving processes of a group of individuals who have high scholastic 
aptitudes, and a group of individuals who have low scholastic aptitudes, 
as measured by the Differential Aptitude Test. Prom these analyses the 
characterisation of mental processes in relation to aptitude should be 
highlighted. This represents an advance over other techniques which have 
been used in the past, which have been anchored in the end-solution, and 
were unable to characterize the processes involved in reaching it. The 
two sub^scales, abstract and verbal, of the Differential i^tltude Test, 
will be analyzed to see if the difference between the two groups, in terms 
of th^, is also significant. Other tes*. ^ i^ich fall into this general 
category of aptitude tests will be noticed also for a further characteriza* 
lion of the high and the low groups. These latter tests were administered 
as pre-tests to these subjects as part of a larger project. 

B. Population: Description of Sample 

Tuo Chicago-area Catholic high schools were chosen as the site for 
the work which provided the material for this. thesis. One of these schools 
was on the north side of the city while the other was on the south side. 
The entire junior class of each school was tested on the pre-test devices, 
and the data from the Illinois Statewide Testing Program were made avail* 
able by the schools. The differential aptitude test was included in the 
Illinois Statewide High School Testing program battery. Prom a total 
population of 532, for which this battery of tests was available, the upper 
ten per cent and the lower ten per cent were selected in terms of their 
raw scores on the Differential Aptitude Test. The Illinois Statewide High 
School Testing Program battery was administered to all the students at each 
school at the same time as a group by the schools themselves, so the condi- 
tions under which the test was taken were roughly the same for all students. 

This selection yielded ninety-two subjects; 45 in the upper group, 
and 47 In the lower group. Since the experiment lasted for more than a 
year, and there were ^ number of students vrtio drop[>ed out of school In 
this time, coupled with the fact that absences could not be controlled, 
the number of students taking any particular problem may vary considerably. 
The mean score for the upper group on the Differential Aptitude Test was 
85.47 while the corresponding score for the lower group was 39.59. The 
standard deviation on this test for the entire class was 13.08, and the 
mean score for the entire class was 63.26. The upper group was 22.00 points 
above the class mean while the lower group was 23.67 below the entire class 
mean. 

The Differential i^titude Test has two sub-scales; verbal and abstract 
reasoning* It can be seen from the following that the characterization by 
the total test is in agreement with the characterization by the sub-scales. 
The mean for the upper group on the verbal sub-scale was 40.71 whll% the 
mean for the lower group on this test was 15.45, The uc^n for the tctal croup 
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fr7J''^« 8Ub-8cale yielded a mean of 

The mean for this total group for the sub-scale was 36.58. 

s^^tiH^ii? Progressive Matrices and the 

Educational Progress (STEP), Mathematics, were ad- 

agreement with the scores on the Differential Aptitude Test. The mean 
for the lower group on the Ravens test was 48. U while the .^ean foHSe 
upper group was 55.61. This nay seem to be a small differe^e iHhis 

group. The mean for the total group for this test was 51.50. The mean 
for the upper group on the STEP test was 38.71 while the mean for the 
lower group was 20.21. The mean for the total group on this test was 

ch.rf!.*';? seun from the above that the upper and the lower groups are 
!S;?nf r f ^SL*"'? groups, by any of the tests tLt^re 

t«J i" Jib?; X '^"^^''^^ paragraphs arc s^r- 



C. Description of the Problems Used 



When this type of research was first initiated at the Loyola Psycho- 
metric Laboratory it was in regard to skills in medical diagnosis If t^ 
AlllTll type of problem the basic i:?!;od";s 

nJ 5 f Situations as described briefly in the review 

?n Jhl J!t •^"'"'k ^PP^^" beginning of this thesis 

in the beginning,problem8 were made up from real life examples and 
had no other formal properties than the fact that they^ all problems 

jL'orobtc::;':'" '^'' "r^ ^^^^^^^ Ju^tLn about 

the problems to gain information that would enable the subject to 
solve the rroblem; in this case, to reach a diagnosis. 
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In the Inst year a method has been developed which permits the experi-* 
menter to apriori build into his problems any type of relationship he wish- 
es and to vary the ci^plexity and the abstract^ers of the problems at will. 
This is done by developing what has been aema, and building the 

problems on the logical relationships co d them. An example of the 
type of schemata that have been developed would be those that have been call- 
ed **tree type schemata**. In Figure 1, an example of this type of schemata 
is presented* 

Figure 1 

Example of a *'Tree Type Schemata** 




The letters could represent anything the experimenter wished, and 
could be presented in language of different degrees of abstractness. An 
exanq;)le of a concrete problem built on this schemata would be to let C 
stand for a dance coomittee at a high school. The B cc.z stand for the 
boys on this committee, and the 6 could stand for ::he , .is that are on 
this committee. The T could be used for those who were responsible for 
the selling of the tickets , and the R could be used for those that are 
handling the sale of the refreshments. We could then vary the amount of 
infonnation available to the subject and ask him to fiad out the number of 
individuals in one of the groups. The difficulty of trie problem can be 
increased both by increasing the number of the relationships used and by 
which position in the schemata we ask the subject to identify. Another 
method whereby the difficulty can be controlled is by the information we 
make available to the subject in terms of the questions, both their con'- 
tent and the way in which they are worded. An example of how we would 
present this problem to a subject would be to ask him how many girls were 
selling tickets. By excluding the possibility of asking some questions, 
especially the direct question, it would be easy to describe the best 
logical attack that could be used to solve this problem a priori. Problems 
of the **A** denotation in this thesis are concrete problems built in a man- 
ner similar to this. In the second degree of abstraction with this same 
schemata as a basis we could let letters stand for the different positions, 
but still present the subject with answers that were numbers. In this case 
we would let the letters stand for themselves in the example shewn in Figure 
I. Problems of the **B** category in this thesis are problems built in a man- 
ner similar to this. If we wanted to make the problems even more abstract 
we could present the answers as numbers in the above example, but present 
the questions in the form of negatives. For example we could phrase the 
questions as to how many are not-g*s and how many are not-t*s. Problems of 
the **C** category in this thesis are constructed in this manner. In the 
final degree of abstraction that appears in this thesis we could present 
the questions and the answers in terms of letters so that the solution 
would be a letter or a series of letters. The ordinary rules of algebra 
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would apply to the manipulation of these letters. Problems of the "D" 
category are constructed in this manner • 

It can easily be seen that the number of the relationships and their 
complexity can be varied depending on the type of schemata developed in 
the initial stages of problem construction. It can also be seen that the 
schemata can be developed to fit the other types of relationships which 
would be desired in this type of context. The problems for these schemata 
could be developed in much the same way as the ones presented above. This 
method of constructing problems has been discussed by Rimoldi, et al., else** 
where (28) at length and the interested reader is directed to that source. 

The presentation of the probleis to the subject is done by printing the 
problem and the questions on separate three by five index cards. The pro«* 
blem itself is presented on the first card (s) and the questions are pre- 
sented each on a separate card on the cards following the first. The 
answers appear on the back of the index cards along with a repetition of 
the questions, so the subject, after asking the question, docs not have to 
refer back to the other side in order to remember the question. In order to 
ask a question the subject merely turns the card over and places it to the 
side so that he may refer back to the inforaation contained at later stages 
in the solution of the problem. Questions which are irrelevant to the pro- 
blem or are at best useless are presented along with the other questions 
which are germaine to the solution of the problem. It should be noted at 
this point that once a subject chooses a particular mode of attack, all 
questions, even though they may contain useful information if the problem 
were attacked in a different manner, can new be considered as useless to 
the subject. That is to say that if a subject begins to find the number of 
pec^le in a certain point in the "tree-type" schemata he may either find 
the number of objects in the total group and attempt to eliminate all others 
or he may go about it by detemining how many are in a sub-group and pro- 
ceed to add up those cases until he has the solution. It can be seen that 
once he starts in either of these directions, to stop and go along another 
would be wasteful. 

The subject is presented the index cards in a deck with the problem 
appearing as the first card and the questions presented on the following 
cards. The subject is instructed to read the problem carefully and then 
to read all the questions. After reading all the questions he is to pick 
the question that he wants answered first, and then turn over the card on 
which it is printed and read the answer. He then repeats this operation 
until he feels he has enough information to offer the solution to the pro- 
blem. 

D. Scoring Methods 

A number of scoring methods were used in this thesis. They are de- 
scribed at greater length elsewhere (28). The basic rationale and pro- 
cedures for each method will be given here but for a fuller analysis the 
reader is directed to the above source. The specific scoring methods used 
in this thesis were: (a) number of questions asked, (b) correct answers to 
problems, both for the group on each problem and for the average number of 
correct solutions on all the problems for each group, (c) schemata norms, 
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(d) plateaux, or number of questions which had no value in the position they 
were asked or were irrelevant to the solution of the problem, (e) convex 
sets, A description of each method will be found below. 

(a) Number of questions asked 

Since the properties of each problem are known it can be calculated 
in advance how many questions are needed to solve the problem. Once this 
is knoiwn anyone exceeding this number has either asked irrelevant questions 
or has not realized that he has enough information to offer a solution to 
the problem. This should then provide a sensitive index as to whether the 
subjects have proceeded at an efficient rate or not« It would follow from 
this that the poor problem solvers , being less efficient and perhaps not 
proceeding in the best logical manner as dictated by the properties of the 
problem, would require more questions to solve the problem than would the 
good problem solvers. The mean number of questions for each group on any 
given problem should then be an index of which group is more efficient at 
problem solving. 

(b) Correct Solutions 

This is the customary method of scoring items in a test and if pro- 
blem solving ability using the present technique is scored in this manner 
we have the similar information to that which is yielded by more conven- 
tional tests. Indeed the items on most intelligence tests are similar to 
these problems in many cases except that they are of shorter length, contain 
all the infonn.viion in the presentation of the problem, and are quite often 
of the multiple- choice variety. We would expect that people who were low 
in intelligence, in this case in scholastic aptitude, would not get as many 
problems correct as those who were high in intelligence, if problem solving 
and intelligence are as highly related as we have claimed. We would also 
expect that any particular problem in the battery would be solved correctly 
more often by the group high in intelligence than by the group which is 
low in intelligence. 

(c) Schemata Norms 

The foregoing methods of scoring the problems are useful but they do 
not take into consideration the order in which the questions are asked by 
the subject. In earlier applications of this technique the total number 
of times a question was asked by a group, i.e., its popularity, was used 
^s an indicator of the value of that question for the solution of the pro* 
blem. The value assigned to this popularity was called the question's 
utility index. This method was especially useful in testing medical diag- 
nostic skill where questions cannot be judged on any qualitative basis for 
their ability to contribute to the solution of the problem in many cases. 
In this case the solution to the problem would be a diagnosis. This was 
the primary method until the development of schemata to build problems upon 
was used. The development of problems baaed on schemata where the logical 
relationships were known by the experimenter and indeed were under his con- 
trol allowed norms to be developed which were based on the problems them** 
selves. It can easily be seen that a scoring method based on the inherent 
difficulty ot the problem and its logical relationships is far superior to 
any that depend on the performance of the group which will vary in quality 
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depending on the group under consideration. This allows for cross group 
coaqparisons to be made against some norm which is not dependent on the 
groups under consideration. 

In a problem of the "tree type" described earlier in this thesis, 
the knowledge of the relationships allows us to determine the correct order 
in which the questions should be asked and what questions are necessary and 
sufficient for the solution of the problem. As an example of this the re- 
lationships inherent in a sample schemata are presented in Figure 2, 

Figure 2 * 

Example of Relationships 
In a "Tree Type" Schemata — 

1^ 

ABC 

* A indicates first order^ B si^cond^ and C third. 

In the example presented in Figure 2, question one should be asked 
first in all the tactics. Question one may be followed by any of the other 
questions but the choice of the second question determinos what the third 
must be. If question two is asked in the second position^ then question 
four must follow; if question four, then question two; if question three, 
then question five; and if question five, then question three. The four 
possible tactics that can used in this example arc presented in summary 
form in Table II , 

There are a number of ways these questions could be assigned weights 
and only the method of scoring eoq>loyed in this thesis is explained here. 
Anyone interested in further weighting techniques should consult Rimoldi, et 
al., (28). Rather than to assign an equal weight to all of the possible 
responses it was decided to weight each response inasmuch as it was a pro« 
portion of the total number of possible responses in all the tactics. In the 
case listed there are twelve possible responses considering both the ques- 
tion and the order in which it may be asked. To make the exmple more mean- 
ingful in terms of the types of problems actually used in this thesis, 
assume that there are ten questions in the example problem and that the 
remaining questions, e.g., questions six through ton, are all questions 
which are irrelevant to the solution of the problem* The next step is to 
arbitrarily impose the value of one for the total number of entries in the 
table. Next add up the total number of times any given response appears in 
a given order and divide thi« by the total number of possible tactics. In 
the example above, question one appeared in the first position four times 
and divided by the total possible number of tactics, four, a value of 
1.00 is obtained. Dividing this result by the total number of questions 
in the problem, a weight of .10 is obtained for the first question in this 
position. Since the other questions will have a weight of .50 in any 
column, yet, since they can appear in either order, they end up with a 
weight of .025. 
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Table II * 

Possible Tactics in the Example Schemata Problem 



Tactics Questions 



1 2 5 4 5 



a 1 2 3 

b I 3 3 

c 1 2 3 

d 1 3 2 



^ (The entries represent order of choice) 

If a subject asked four questions on our san^le problem; one^ three, 
five, and eight, in that order, he would be scored as follows: he would 
receive a value of .100 .025 ^ .000 or a total of .ISO. It can be seen 
that this can be scored as a cumulative value and that an individual per«- 
formance curve which is representative of the agreement with, or the de* 
parture from the schemata norms for the problem under consideration, can 
be drawn. This type of analysis has been made in other publications but 
has not been attempted here (16,28) • It can also be seen that the curve 
obtained from this type of cumulation is an observed value score. If each 
observed score is corrected by the amount it is expected by chance alone, 
the resulting curve is called the Observed minus the Expected curve. The 
theoretical values for a question being asked in any given position as a 
function of the total number of questions possible is given in a paper by 
Rimoldi and Georgas (17) • The amount of separation that occurs between the 
two lines is also an indication of the quality of the process that the sub-^ 
ject has used in atten^ting to solve the problem. 

(d) Plateaux 

It can be seen from the foregoing section that some of the questions 
asked by the subject may have a zero value for this type of scoring system 
where irrelevant questions are used and the position in which the question 
is asked are tak^^n into consideration. Since the number of these zero re- 
sponses is an indication of the quality of the process itself, an analysis 
in terma of them might prove useful. In this papar the zero responses are 
referred to as plateaux. The mean number of zero questions asked by each 
subject for each group on each problem is an indication of the number of 
valueless or irrelevant questions that each subject in a given group asked 
on any problem. This is referred to as the mean length of plateaux. The 
proportion of the total number of responses that are valueless on any given 
problem for each group can also be calculated. This will be an indication 
of the amount of the subjects* total responses in the group that are con« 
tributory to the problem and those that are not. This score is also given 
in the section on results for each group and for each problem. 



It should be emphasized that zero responses can be obtained by either 
asking questi<ms which are irrelevant to the problem or by asking questions 
in a sequence Which does not agree with the schemata norms. This could 
occur in two ways, either the subject could merely ask a question that has 
value in another position or another sequence or he could begin a sequence 
CHily after asking irrelevant questions. In this second case the questions 
although in the proper order would not be in the proper position since they 
would have been forced back a number of positions equal to the number of 
irrelevant questions that were chosen. 

(e) Convex Sets 

If the two points, the observed (0) and the observed minus the ex* 
pected (0-E) are plotted for the final cumulative value for a subject, 
these points can be plotted on a graph such that the quality of his 
process is indicated by his position on the graph* This can be done for 
all the subjects in each group and by having points represent one group 
and crosses represent the other group, comparisons can be made of the two 
groups in regard to where their members appear on the graph. This graph is 
constructed so that the values on the abcissa represent the 0 values while 
the values on the ordinate represent the 0-E values. Those subjects in the 
upper right hand corneir will be those whose process is in closest agreement 
with the schemata norms while those in the left lower corner will be those 
subjects whose performance departs the most from the schemata norms. Any 
point in between these extremes will indicate more or less agreement with 
the schemata norms according to its position* The plotting of these values 
in this way generates a convex set. The amoxrnt of common space shared be- 
tween the two resultant figures so constructed indicates the types of 
processes which were common to the two groups i^ile the space not shared 
Indicates those processes which were unique to one group*. 



Chapter IV. 



RESULTS 

A. Number of Problems Correctly Solved, 

The upper group had thirty-eight subjects who completed all the pro- 
blems. The lower group had twenty-eight who completed all the problems. 
The difference between the number of coii?)letions for the two groups was due 
mainly to absences on the day of testing. The thirty-eight subjects in the 
upper group solved a total of 288 problems of those administered while the 
lower group solved 136. The total number of possible solutions for the 
upper group was 342 while the corresponding number for the lower group was 
252. The mean number of problems solved correctly per subject in the upper 
group was 7.579. The corresponding figure for the lower group was 4.857. 
These means were found to be significantly different at greater than the 
.01 level. 

The number of subjects who solved each problem correctly was also ana- 
lyzed and a chi square test was performed on the correct and the incorrect 
solutions for each group for each problem. The result of the chi square 
analysis is shown in Table III. It can be seen that for all the problems 
where there was a proportion large enough that a chi -square could be run, 
the difference between the two groups is significant at either the .01 
level or the .001 level in each case. The differences between the number 
of correct and incorrect soluticxis for problems Nos. 41B, 39A, 43A, and 
43B were not significant according to Fisher's Exact Probability. It can 
be seen from the foregoing that scHoe of the tests were able to differen- 
tiate between the two groups while others could not. It is suggested 
that if an item analysis were made on the items of the Differential Apti- 
tude Test the results would also iiuiicate that there were items which were 
answered correctly by a large number of both groups. 

Table III 

Chi-Square Analysis of Correct and Incorrect 

Solutions* 

35A 35B 35C 35D 39A 

9.38** 17.63*** 18.00*** 2 7. 90***. 138**** 

39B 41A 43A 43B 

8.22** 11.16*** .107**** .123**** 

* Chi-square values corrected for small sonple. 
** Significant at greater than the .01 level 
***Significant at greater than the .001 level 
**^Not significant-Fisher's Exact Probability 
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Table V 



Mean Number of Questions for 
Both Groups on Each Problem 





35A 


35B 


35C 


35D 


41A 


43A 


43B* 


39A 


39 B 


Upper 


5.41 


5.81 


5.45 


5.22 


5.33 


5.48 


5,19 


.'.40 


5.38 


Lower 


5.67 


5.18 


5.67 


5.54 


5.00 


5.54 


6.74 


f:.9i 


5.83 



* The difference on this problem was significant at the .001 level. All 
others were not significant. 

C Plateauac: Analysis of Valueless Questions 

If a valueless question is asked the scoring system described earlier 
in this thesis in the section on schemata norms gives no score to that re** 
sponae. A valueless question can occur in two ways. In the first case 
Irrelevant questions are placed in the problem and if these arc chosen by 
the subject no score is given since they in no way contribute to the 83lu* 
tion of the problem and indeed indicate a lack of understanding on the part 
of the subject as to the exact nature of the problem. The other way that 
a question can receive a score of zero is to be asked out of the sequence 
of the schemata. These responses of either type are called zero responses 
in this thesis since they are scored as zero with the method of scoring 
used here, A number of these responses occurring in the same problem con-^ 
stltutes what has been called a plateaux (28). A plateaux may vary in 
length from one question to the total number of questions that a subject 
BBkB^ A plateaux can be said to indicate the number of questions that 
were used \^ich were of no value in solving the problem or were not pro- 
perly in the sequence demanded by the logical structure of the problem* 
The length of a plateau is the same as the number of questions asked that 
were of no value. Table VI shows the mean length of plateaux for the upper 
and the lower groups on problems 35A, 35B» 35C» 3SD» and 41A. The other 
four problems mentioned elsewhere in this thesis were not analyzed in terms 
of schemata norms because these norms had not been developed when this 
thesis was written. The outline stated that one problem of each type would 
be analyzed in this manner and this has been done. 

Table VI 



Mean Length of Plateaux for the 
Upper and the Lower Groups 





35A 


35B 


35C 


35D 


41A 


upper 


1.66 


2.40 


1.40 


1.80 


1.98 


Lower 


3.05 


2.41 


2.80 


4.10 


2.74 


t Values 


2.46 


.001 


2.71 


4.98 


5.24 


Sig. 


.01 


0.7 


.005 


.0005 


.0005 
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It can be seen from Table VI that the difference is significant in 
favor of the upper group on every problem but problem 35B. This difference 
seems to increase both as a function of the difCiculty of the problem and 
of how late in the study it was presented to the students, since the order 
in the Table is the sanie order in which the subjects received these parti- 
cular problems. 

Since the number of zero responses is not only a function of the 
type of question asked and the order in which it is asked, but also of the 
total number of questions asked, the present author feels that a more sensi- 
tive measure would be the proportion of the total number of responses for 
each group that were scored as zero responses. These data are summarized 
in Table VII. The difference between the two groups is made even greater 
by this type of analysis. This may be accounted for by the fact that ' 
aooie students in the lower group asked only two or three questions and then 
gave up and attempted to guess at the answer to the problem without the 
necessary information. This occurred nore often the more difficult the pro- 
blem was on which they were working. This was quite often the reason why 
the lower groups mean number of questions was as low as it was on many of 
the difficult problems. It seems that the lower groap was not motivated to 
aeek out the proper solution of the problem after having received only oar- 
tial informatian. *^ 



Table VII 



Proportion of Total Respon?es That Were Scored As Zero* 



Upper 


35A 


35B 


35C 


15D 






.41 


.25 


.34 


■ — 


Lower 


.54 


.44 


.53 


.73 


.57 


Chi Square Value 


24.46 


1.97 


25.91 


62.78 


12.18 


Significance 


.001 


.2 


.001 


.001 


.001 



*Chi-square was derived from the number of zero responses and the number 
of value responses in a four fold contingency table. 

D Convex Sets 

The data in this section actually represent a special application 
of the schemata norms that were discussed earlier. If a graph is drawn 
on vhich the observed (0) values are represented on the abcissa and the 
observed minus the expected (0-E) values are drawn on the ordinate, a 
figure is generated which has been called a convex set in earlier publi- 
cations (e.g. 28). Each subject is represented by a single point on the 
graph. Those scores in the upper right hand area of the figure represent 
those subjects whose approach was in closest agreement with the schemata 
norms. Those points which represent the furthest departure from the 
schemata norma will be found in the lower left hand area of the graph. It 
is impossible because of the inherent properties of the scoring method that 
any points appear in the upper left hand corner since this would make the 
corrected value higher than the uncorrected value. Points which are to the 
right of the graph but which are lower than the extreme represent subjects 
who asked questions in the proper otder but then continued to ask questions 



which were, of course, then bcyona the limits of the scheiaata norms and 
were thus scored as zero. It seems logical that a subject who has enough 
insight into the ctructure of the problem to ask the questions in the pro- 
per order would also have sufficient insight to know when he had enough 
information to solve the problem. Since there are tactics of this type at 
all it seems that research on the personalities involved would be interest- 
ing and rewarding. Perhaps this type of performance Is related to some trait 
such as compulsivity. Any point between the upper right and the lower left 
can be said to be in agreement with or a departure from the schemata nonns 
inasmuch as it is close to either extreme. In Figures 3 through 6, the upper 
group is represented by dots while the lower group is represented by crosses. 
The extremes for both groups are connected in each of the graphs. The solid 
line indicates the extremes for the upper group while the broken line in- 
dicates the extremes for the lower group. The space enclosed by these lines 
indicates the types of tactics that were shared by the two groups where the 
area is common to both groups. The area which is not shared on the graphs 
is an indication of the processes that were unique for <Mie group and did 
not appear in the other group. The graphs for problem 35B and 35D show 
the greatest amount of difference between the two groups. The tactics re- 
presented by the area that is comaon to the two graphs. which indicates 
tactics coonon to the two groups, is of extreme interest. On all of the other 
tests and methods of scoring represented in this thesis there is evidence 
to support the fact that these are two extremely different groups. Yet in 
this mode of interpretation there is a considerable amount of overlap be- 
tween the two groups. It would be interesting to see if the correlation 
with grades were higher for the number indicated on this graph by a point 
or for the score on the Differential Aptitude Test. ! 

Since this method of representing the group's performance seems to 
indicate that there is much overlap between the two groups, it would seem 
that a study which would isolate the value of this method of scoring as a 
predictor of scholastic performance would perhaps yield valuable results. 
Not only have we represented the quality of the subject's performance on 
these graphs but we have indicated his departure from chance. It would 
seem that additional research is warranted on this topic. There is some 
indication from earlier rer.oarch on training in problem solving (28) that 
this ability to solve problems with a process that is in agreement with the 
scnemata norms, or more clearly, in line with the logical structure of the 
problem is related to grades in certain subjects. Perhaps further research 
would clarify this relationship and indicate the possibility of using this 
method of studying problem solving as a test for prediction or selection 
of students for honors or accelerated classes where creativity and the 
ability to think rather than to do rote memorization and reproduce is the 
important criterion- 
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Figure 3 i 
Convex Set for 35 A I 
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Figure 4 
Convex Set for 35 B 
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Figure 5 
Convex Set for 35 C 
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Figure 6 
Convex Set for 35 D 
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Chape r V 
SlMiASY 

Prom a group of 532 Chicago area high school juniors a group that 
scored high on the Differential Aptitude Test and a group that scored low 
on the same test were selected. These groups were given nine problems of 
the type developed by Rimoldi and associates at the Loyola Psychometric 
Laboratory* A number of scoring methods were applied to the problems to 
determine the differences that existed between the two groups in relation 
to this type of test. The interesting thing about analyzing problem solv- 
ing in this manner is not only does it allow the conventional analysis of 
the right and wrong answers but allows the experimenter to study the pro- 
cesses or tactics used by the subject to reach that end-product. 

The upper group got more of the problems right than did the lower 
group. The score for the number of problems right for each subject was 
higher for the upper group than the corresponding score for the lower group. 
The differences between the mean values for these scores was found to be 
significant in both cases. The mean number or sero, i.e* worthless, items 
asked by the upper group and the proportion of the total number of questions 
asked that were zero, was less for the upper group than for the lower group 
on each of the problems analyzed in this way. The mean number of questions 
asked for each problem was less for the upper group than for the lower 
group on seven of the nine problems, while the relationship was reversed 
on the other two problems. 

It was shown that by plotting a point on a graph that was repre- 
sentative of the quality of the process an individual had used to solve 
the problem, interesting differences between the two groups could be ob- 
served. It was stated that this type of analysis suggested that further 
research along these lines would prove rewarding. It was also suggested 
that a study be made attempting to find the relationship between this type 
of test and grades in school, with the hope that this type of test could 
prove useful as a selection device and for the discovery of creativity and 
talent. 

It can be seen from the foregoing analysis that there are great dif- 
ferences in the ability to arrive at the correct solution of a complex pro- 
blem between a group that is high on the Differential Aptitude Test and 
a group that is low on the same test. This difference becomes very slight 
however, when the processes utilized to arrive at this solution are analyz- 
ed. These processes are called tactics in this thesis. From the material 
in this thesis it can be seen that the information obtained from the pro- 
blem solving approach developed by Rimoldi and associates not only gives 
us the information available from conventional testing methods but gives 
us additional information about the tactics the testee used to arrive at 
his answer. 
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Problem 35 A 

Instructions and Corresponding Questions and Answers 



A college choral group is composed of freshmen, sophomores and juniors. 
The chorus has three voices or parts which are high, medium, and low. The 
questions and answers below give vital information concerning the group. 
Prom these facta you are to find the number of juniors singing the middle 
or medium part. 



Questions Answers 



1. 


How 


many 


Juniors are in this college? 


1. 


1567 


2. 


How 


many 


Freshmen are in the chorus? 


2. 


23 


3. 


Urn 


many 


Sophomores are in the middle voice? 


3. 


10 


k. 


How 


many 


chorus members are there? 


k. 


76 


5. 


How 


many 


girls are in the chorus? 


5. 


45 


6. 


How 


many 


sophomores are in the chords? 


6. 


28 


7. 


How 


many 


juniors sing the high voice? 


7. 


7 


8. 


How 


many 


freshmen are in this college? 


8. 


1848 


9. 


How 


many 


freshmen sing the high voice? 


9. 


8 


10. 


How 


many 


low voice members are there? 


10. 


28 


11. 


How 


many 


sophomores sing the high part? 


11. 


9 


12. 


How 


man^r 


plmos does the chorus have? 


12. 


3 


13. 


How 


irany 


freshmen sing the low voice? 


13. 


9 


14, 


How 


many 


chorus members sing the high voice? 


14. 


24 


15. 


How 


many 


juniors are in the low voice section? 


15. 


10 


16. 


How 


many 


freshmen sing the middle voice? 


16. 


6 


17. 


How 


many 


sophomores sing the low part? ^ 


17. 


9 



Solution: 8 juniors 
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Problem 35 B 

Instructions and Corresponding Questions and Answers 

T objects are composed of M,N. and P types. Each of these latter 

inrLiS"' "^'^ °' "^^ S'S. Prom the flieJtions 

and answers you can discover the various relationships of these^iec^s 

a^Vs'anl aJs" ^^"^"^ ^"^^--^^ - ^-er^ine Sow manyToS^tl" 

Questions 

1. How many S's are A*s? 

2. How many Q's are there among the T's? 
3* How many G's arc there amorgthe T's? 
^. How many R»s are also N*s? 

5. What is the total number of T objects? 

6. How many p»s are there among the T's? 

7. How many R's are there among the T's? , 

8. How many Q's are also M*s? 
5. How many R's are also M's? 

10. How many S's are also M's? 

11. How many Q'a are A'a? 

12. How many R's are also P's? 

13. How many Q»s are also N's? 
1^. How many S's are also P's? 

15. How many M»s are among the T's? 

16. How many Q»s are also p's? 

17. How many H's among the A's? 





Answers 


1. 


3ji/ 


2. 


19 


3. 


43 


4. 


8 


5. 


63 


6; 


21 


7. 


24 


8. 


5 


9. 


10 


10. 


2 


11. 


400 


12. 


6 


13: 


3 


14. 


4 


15. 


17 


16. 


n 


17. 


2 



Solution: 14 T objects are N's and also S's 
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Problem 35 C 



Instructions and Corresponding Questions and Answers 



A class of objects is distinguished by calling some B*s and soine 
other not-B*s depending on the possession or non-possession of a cer- 
tain property. The not-B's are further distinguished into not-X*6, 
not-Y*s, and not-Z«s, Each of these latter may also be a not-D, 
not-E, or not-F. Prom the accompanying questions and answers you can 
discover the relationships that exist between these objects. Make use 
of the information available to determine how many not-B objects are 
not-y»s and also not-F* s. 





Questions 






Answers 


1. 


How many not-D' s arc not-A's? 






1. 


150 


2. 


How many not-P's are also not-X'8? 






2. 


7 


3. 


How many not-E' s are there amonc the 


not-B' 


s? 


3. 


15 


4. 


How many not'^G's are there among the 


not-B' 


s? 


4. 


30 


5. 


What is the total number of not-B' s? 






5. 


45 


6. 


How many not-E* s are also not-Y's? 






6. 


6 


7. 


How many not-D' s are there among the 


not-B' 


s? 


7. 


6 


8. 


How many not-F '8 are not A's? 






8. 


100 


9. 


How many not-E' s are also not-Z's? 






9. 


5 


10. 


How many not-D' s are also not-Y's? 






10. 


2 


11. 


How many not-P's are also not Z's? 






11. 


9 


12. 


How many not-X's are there among the 


not-B' 


s? 


12. 


12 


13. 


How many not-D' s are also not-Z's? 






13. 


3 


14. 


How many not-H's are there among the 


not-A' 


s? 


14. 


2 log cos 30 


15. 


How many not-E' s are also not-X's? 






15. 


4 


16. 


How many not-Z's are there among the 


not-B' 


8? 


16. 


17 


17. 


How many not-D' s are also not-X's? 






17. 


1 




Solution: 8 not-B objects arc not-Y 


's and 


also 


not-P 


•s 



Problem 35 D 



Instructions and Corresponding Questions and Answers 



A group of L objects taken from a larger group of M objects is 
composed o£ objects of the kind A,Bt and €• If an object is an A, it 
can not be a B or C. If an object is a B, it can not be an A and/or C. 
If an object is a C, it can not be a B and/or A^.That is, A,Bt and C. 
are mutually exclusive. The same L objects also have properties DfE« 
and P which are mutually exclusive. 

From the questions below you are to find how many of the B's are 
also P's. 



Questions Answers 



1. 


How many F's are In J? 


1. 


U 


2. 


How many L*a are D's? 


2. 


M ♦ N + 0 ■ X 


3. 


What la the number of L'a? 


3. 


M+N+OR+Q+P+S+T+V" 










X*Y+2«G*H*IaL 




How many E'a 


are B's? 


4. 


Q 


5. 


How many L'a 


are K's? 


5. 


W 


6. 


How many D'a 


are in M? 


6. 


X - M ♦ 0 


7. 


How many L'a 


are E's? 


7. 


R ♦ Q ♦ P ■ Y 


8. 


How many P'a 


are A's? 


8. 


S 


9. 


How many E'a 


are A's? 


9. 


R 


10. 


How many D'a 


are A's? 


10. 


M 


11. 


How many L'a 


are C's? 


11. 


0 ♦ P ♦ V » I 


12. 


How many F's 


are C's? 


12. 


V 


13. 


Hew many L'a 


are A's? 


13. 


M ♦ R ♦ S ■ G 


14. 


How many D's 


are C's? 


14. 


0 


15. 


How many U's 


are M's? 


15. 


U - J 


16. 


How many D's 


ore B's? 


16. 


N 


17. 


How many E's 


are C's? 


17. 


P 



Solution: T of the B's are also P*8 



Problem 3S A 

Instructions and Corresponding Questions and Answers 



A man wished to buy an automobile. After investigating all of the 
makes available, he found three types of automobile, A, B, and C, that 
were suited to his needs. In choosing among these three he decided to 
buy the one that would cost the least. Which type of automobile did he 
buy, A, B, or C? 



Questions 



Answers 



1. 


What was the total cost of car A? 




1. 


2000 pounds 


2. 


What was the total cost of car B? 




2. 


8000 francs 


3. 


What was the total cost of car C? 




3. 


250,000 pesos 


4. 


What is the value of a pound in 






$2.50 




United States currency? 






5. 


What is the value of a pound in 










French currency? 




5. 


10 francs 


6, 


What is the value of a pound in 










Spanish currency? 




6. 


250 pesos 


7. 


What is the value of a franc in 










United States currency? 




7. 


$ .25 


8. 


What is the value of a franc in 










English currency? 




8. 


.1 pound 


9. 


What is the value of a franc in 










Spanish currency? 




9. 


25 pesos 


10. 


What is the value of a dollar in 










English currency? 




10. 


A pound 


11. 


What is the value of a dollar in 










French currency? 




11. 


k francs 


12. 


What is the value of a dollar In 










Spanish currency? 




12. 


100 pesos 


13. 


What is the value of a peso in 






$ .01 




United States currency? 




13. 


Ik. 


What is the value of a peso in 










English currency? 




U. 


.004 pound 


15. 


What is the value of a peso in 










French currency? 




15. 


.04 franc 



Solution: Car B 
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Problem 39 B 

Instructions and Corresponding Questions and Answers 

There are three objects, X, Y, and Z. Each object has a value that 
can be stated in terms of a, b, c, or d. Prom the following questions 
select those that you consider necessary to determine which of the three 
objects has the smallest value. 



Questions Answers 



1. 


What 


is the value of X? 






1. 


100a 


2. 


What 


is the value of 


Y? 






2. 


400b 


3. 


What 


is the value of 


2? 






3. 


12,500d 


4. 


What 


is the value of 




stated 


in 




5. 




terms of **c''? 








ft. 


2.5c 


What 


is the value of 


"a" 


stated 


in 








terms of "b'^? 








5. 


10b 


6. 


What 


is the value of 


"a" 


stated 


in 






terms of "d"? 








6. 


250d^ 


7. 


What 


is the value of 


fty. 


stated 


in 




8. 




terms of "c"? 








7. 


.25c 


What 


is the value of 




stated 


in 








terms of "a"? 








8. 


.la 


9. 


What 


is the value of 


•tjjtt 


stated 


in 




10. 




terms of "d*»? 








9. 


25d 


What 


is the value of 




stated 


in 




11. 




terms of **a'*? 








10. 


.4a 


What 


is the value of 




stated 


in 




12. 




terms of "b"? 








11. 


4b 


What 


is the value of 


•*c*' 


stated 


in 


13. 




terms of "d"? 








12. 


lOOd 


What 


is the valu« of 


•»d" 


stated 


in 


14. 




terms of "c"? 








13. 


.01c 


What 


is the value of 




stated 


in 


15. 




terms of "a"? 








14. 


.004a 


What 


is the value of 


••d" 


stated 


in 






terms of "b"? 








15. 


.04b 



Solution: Y 
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Problem 41 A 

Instructions and Corresponding Questions and Answers 

At a textile factory in a small town the telephoae system connecting 
the various factory offices is rather primitive « However, camnunications 
between offices is greatly aided by the network since the offices are con«- 
siderably separated. 

Basically, the factory has a north wing comprising offices A, B, and 
C, and a south wing in which are offices D, E, F, H, and G, At the time the 
phones were installed only seven were available and consequently office G 
is without one. Because of the way in which the phones have been wired 
certain limitations have been placed on their use. The limitations are 
these: 

1) There is not a single phone from which all the other offices with 
phones may be called. 

2) The fact that one office can call another does not necessarily 
mean that the last office can call the first. 

with this present confusion in the telephone network a worker in office 
B would like to contact someone in office H. What is the most efficient 
way in which this can be accomplished? 



Questions Answers 



1. 


I8 there a line from any office in 








the North wing to H? 


1. 


No. 


2. 


Which office can Issue outgoing calls to the 








greatest number of other offices? 


2. 


Office E 


3. 


What offices can office C call? 


3. 


Offices D & B 


k. 


Can office A call office H? 


4. 


No 


5. 


Prom which offices in the south wing can 


5. 


Only from 




office H receive calls? 




Office D 


6. 


What offices in the north wing can call 








offices in the south wing? 


6. 


Only Office C 


7. 


Can every office in the north wing call every 








office in the south wing? 


7. 


No 


8. 


Can office B call Office A? 


8. 


Yes 


9. 


What offices in the north wing can call office C7 


9. 


Only Office B 


10. 


Can office C call office B? 


10. 


No 


11. 


What offices can office H call? 


11. 


None 


12. 


Can every office in the south wing call 








every office in the north wing? 


12. 


No 


13. 


What offices can office B call? 


13. 


Offices A, B, C, 








D, and F 


14. 


Can office B call Office H? 


14. 


No 


15. 


Can any office in the south wing call any office 








in the north wing? 


15. 


Yes, only office E 



Solution: B C D H 
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Problem 43 A 

Instructions and Corresponding Questions and Answers 

A man owns some race horses. Oie of his horses won a race yesterday. 
Your problem is to determine which of his horses won the race. 



1. How many race horses docs the man own? 



2. 
3. 

5. 

6. 

7. 

S. 

9. 
10. 
11. 



Does he ever run all of the horses on the 
same day? 

Does he ever run three horses on the 
same day? 1 
Does he ever run two horses on the same 
day? 

Are there any days irtien he only runs one 
horse? 

Does Magic Realm ever race alone? 
Does Prince Jet ever race alone? 
Does Secessionist ever race alone? 
Does Lethal ever run with Prince Jet? 
Hew many of his horses ran yesterday? 
Does Magic Realm ever run with Prince Jet? 



12. Does 

13. Does 

14. Does 

15. Does 

16. Does 

17. Does 

18. Does 

19. Does 



Magic Realm ever run with Secessionist? 
Magic Realm ever run with Lethal? 
Prince Jet ever run with Secessionist? 
Prince Jet ever run with Lethal? 
Secessionist ever run with Lethal? 
Prince Jet ever run with Magic Realm? 
Secessionist ever run with Magic Realm? 
Secessionist ever run with Prince Jet? 



20. Does Lethal ever run with Secessionist? 



1« He owns four horses 
Magic Realm, Prince 
Jet, Secessionist, 
and Lethal. 

2. No 

3. No 

4. Sometimes 

5« Yes, on some days 

6. Nc 

7. No 

8. Nc 

9. No 

10. One 

11. Yes, whenever Magic 
Realm races. Prince 
Jet also races. 

12. No 

13. No 

14. Yes, sometimes 

15. No 

16. No 

17. Yes, sometimes 

18. No 

19. Yes, whenever 
Secessionist runs. 
Prince Jet also 
runs 

20. No 



Solution: Lethal 
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Problem 43 B 

Instructions and Corresponding Questions and Answers 

«ei r^K-^'''' one object from a number of objects. Before he could 
d!in?L^S ^ displayed before him. Each object could be 

ni«vi^h . "^'^^ ^^^^^^ ^^'^^^^^ Although there were some dia- 



1. 
2. 

3. 



5. 

6. 

7. 

B. 

9. 
10. 
11. 



How many objects are there? 

Do all of the objects ever occur in the 

same display? 

Do three object ever occur in the same 
display? 

Do two objects ever --.^.cur in the same 
display? 

Is one object ever displayed alone? 

Does A ever occur alone? 

Does B ever occur alon^ 

Does C ever occur alone? 

Does D ever occur with B? 

How many objects were displayed? 

Docs A ever occur with B? 



1*^. Does 

^ Does 

14. Does 

15. Does 

16. Does 

17. Does 

18. Does 

19. Does 



A ever 
A ever 
B ever 
B ever 
C ever 
B ever 
C ever 
C ever 



occur 
occur 
occur 
occur 
occur 
occur 
occur 
occur 



with C? 
with D? 
with C? 
with n? 
with D? 
with A? 
with A? 
with B? 



20. Does D ever occur with C? 



1 

1 . 


rour: A,B,C, and 0 


2. 


No 


3. 


No 


4. 


Yes, sanetimes 


5. 


Yes, sometimes 


6. 


No 


7. 


No 


8. 


No 


s. 


No 


10. 


One 


11. 


Yes, A always 




occurs w*.th B 


12. 


No 


13. 


No 


14. 


Yes, socaetitaes 


15. 


No 


16. 


No 


17. 


Yes, sooetimes 


18. 


No 


19. 


Yes C always occu; ^ 




with B 


20. 


No 



-~-5clutior. • D 
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Table I * 

Values Corresponding to Each Group According to the Scoring Method 
Based on the Schemata for Problem No. 35 A 

Questions 

Order 2 3 4 6 7 10 14 15 16 

1. 0588 

2. 0147 0147 0147 0147 

3. 0147 0147 0147 0147 

0147 0147 0147 0147 

5. 0147 0147 0147 0147 

* All questions which do not appear in this Table receive a score of zero. 

Table II * 

Values Corresponding to Each Group According to the Scoring Method 
Based on the Schemata for Problem No. 35 B 

Questions 

Order 2 4 5 6 7 10 13 14 15 

1. 0588 

2. 0147 0147 0147 0147 

3. 0147 0147 0147 oi47 

, 0147 0147 0147 

% 

5. 0147 0147 0147 0147 

* All questions which do not appear in this table receive a score of zero 
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Table III * 



Values Corresponding to Each Group According to the Scoring Method 
Based on the Schemata for Problem No. 35 C 



12 16 

0147 0W7 
0147 0147 



Questions 

Order 2 3 5 6 7 10 11 

!• 0588 

2. 0147 0147 

3. 0147 0147 
0147 0147 0147 0147 

5. 0147 0147 0147 0147 

* . All questions which do not appear in this Table receive a score of zero. 

Table IV * 

Values corresponding to Each Group According to the Scoring Method 
Based on the Schemata for Problem No. 35 D 



Questions 

Order 2 3 4 7 8 11 12 

1. 0588 

2. 0147 0147 0147 

3. 0147 0147 0147 

4. 0147 0147 0147 

5. 0147 0147 01^7 



13 16 

0147 
C147 

0147 
0147 



* - All questions which do not appear in this Table receive a score of zero. 



